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Abstract 

Composite Overwrapped Pressure Vessels (COPVs) that have survived a long service time under 
pressure generally must be recertified before service is extended. Flight certification is dependent on the 
reliability analysis to quantify the risk of stress rupture failure in existing flight vessels. Full certification 
of this reliability model would require a statistically significant number of lifetime tests to be performed 
and is impractical given the cost and limited flight hardware for certification testing purposes. One 
approach to confirm the reliability model is to perform a stress rupture test on a flight COPV. Currently, 
testing of such a Kevlar49 (Dupont)/epoxy COPV is nearing completion. The present paper focuses on a 
Bayesian statistical approach to analyze the possible failure time results of this test and to assess the 
implications in choosing between possible model parameter values that in the past have had significant 
uncertainty. The key uncertain parameters in this case are the actual fiber stress ratio at operating 
pressure, and the Weibull shape parameter for lifetime; the former has been uncertain due to ambiguities 
in interpreting the original and a duplicate burst test. The latter has been uncertain due to major 
differences between COPVs in the database and the actual COPVs in service. Any information obtained 
that clarifies and eliminates uncertainty in these parameters will have a major effect on the predicted 
reliability of the service COPVs going forward. The key result is that the longer the vessel survives, the 
more likely the more optimistic stress ratio model is correct. At the time of writing, the resulting effect on 
predicted future reliability is dramatic, increasing it by about one “nine,” that is, reducing the predicted 
probability of failure by an order of magnitude. However, testing one vessel does not change the 
uncertainty on the Weibull shape parameter for lifetime since testing several vessels would be necessary. 

Nomenclature 

I indicator random variable, with outcomes 0 or 1 

MOP maximum operating pressure 

N number of vessels 

Pf probability of failure 

R reliability 

T rcf reference temperature (81 °F) 
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Weibull based correction factors for thru-thickness gradients in the overwrap 
beta distribution parameters 
probability density function 
indices, 0 or 1 

posterior density 

number of past mission cycles of duration t mc 

number of future mission cycles of duration t mc 

probability 

fiber stress ratio 

time in hours 

current mission time 

cumulative time for n missions 

characteristic time corresponding to a re f 

multiplicative weight factors for probabilities (p) which depend on n and m 
delta volume (permanent volume growth due to proof test or autoffettage) 
gamma function 
parameter space 

Weibull shape parameter for fiber stress at burst 
Weibull shape parameter for fiber lifetime 
likelihood function 

random variable reflecting uncertainty in stress ratios used to generate the LLNL 
database 

vector of possible uncertainty parameter values 
mean value of an uncertainty parameter 

power law exponent relating lifetime to fiber stress level for stress 

nominal fiber stress in overwrap 

standard deviation of an uncertainty parameter 

nominal fiber stress in overwrap at burst pressure 

coefficient of variation of an uncertainty parameter 

Subscripts 

number of past missions 

number of future missions 

serial number of the vessel 

serial number of the vessel 

Orbiter 

Model 2 

Model 4 

reference 

elevated 
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Introduction 


We study the effects of various test parameter choices on possible outcomes from the accelerated 
stress-rupture testing of a single, 40-in. diameter, Kevlar49/epoxy composite-overwrapped pressure vessel 
(COPV) with a titanium liner, called SN007. In particular we focus on the implications of particular test 
survival times (or the failure time) on reliability predictions for multiple such vessels in future missions 
cycles of given time durations. The context is that much prior stress rupture test data is available on the 
stress-rupture performance of Kevlar49/epoxy strands and laboratory scale vessels, thus allowing the 
prediction of reliability for a given stress ratio and time in service, but the details in terms of the yam 
denier, the epoxy and the wrap pattern differ significantly. Furthermore, the exact stress ratio (stress level 
in service divided by maximum stress level from a burst test) is uncertain since (i) only two burst tests 
had originally been performed but with conflicting results, (ii) quality control measurements in terms of 
permanent delta volume growth during the proof test (autofrettage) differed by a factor of two across the 
various production and qualification test units, and (iii) stress analysis based on instrumentation of the 
burst tests and the design configuration led to conflicting stress ratio predictions for the vessels in service. 
This has resulted in considerable uncertainty in their actual reliability making predictions necessarily 
more conservative. In addition there was uncertainty in the true Weibull shape parameter for lifetime, a 
key measure of the fundamental material variability. These past analyses and data, discussed in two white 
papers (Refs. 1 and 2), have pointed to two possible values of the stress ratio and two possible values of 
the Weibull shape parameter for lifetime, but with ambiguity on which pair actually applies to the 40-in. 
COPVs in question. The purpose of the single stress-rupture test on SN007 was to provide definitive 
information on which pair of key parameter values best describes the behavior of 40-in. of Kevlar49/49 
COPVs in question, since the predicted lifetime for the two pairs of parameter values differs by more than 
an order of magnitude. 

Since an extensive and fairly consistent data base is available on both ambient and elevated 
temperature performance of Kevlar49/epoxy materials and small test vessels, the test was also accelerated 
in time by a factor of about 40 (under the pessimistic parameter assumptions) using a higher steady 
temperature than occurs in service (though not higher than has typically occurred in the past during the 
pressurization phase) but at the maximum operating pressure used in service. This strategy was designed 
to provide the necessary test information in a few months rather than the 200,000 hr (28.5 yr) that would 
be required under standard service conditions. In fact, two temperature levels were selected to be run in 
sequence: the first at 130 °F was to be applied until the time corresponding to mean reliability of 0.9986 
was reached under the most pessimistic stress ratio and Weibull lifetime parameter values. At that point 
the temperature was to be increased to 160 °F and the test continued until the vessel either fails in stress 
rupture or survives a pre-set time at which a third stress level would be contemplated. 

Given the significant prior history and knowledge regarding several of the key model parameters 
(Ref. 3), the problem could be cast in a Bayesian statistical framework and model with uncertainty 
distributions on all the material stress-rupture parameters (based on statistical analysis of the extensive 
prior material data sets) as well as discrete Bernoulli uncertainty distributions on the two possible pairs of 
stress ratios and Weibull lifetime shape parameter values. Specifically, the result of the test are to permit 
resolution in choosing between (i) two competing stress ratio models (see ref. [2]), an optimistic Model 2, 
and a pessimistic Model 4 (equivalent to the currently used model) and (ii) two competing values for the 
Weibull lifetime shape parameter, a value 1 .625 based on the Lawrence Livermore National Laboratories 
(LLNL) data base on small Kevlar49/epoxy COPVs, and 2.45 based on the authors’ study of the NASA- 
JSC Fleet Leader vessel data, which is more relevant to the Kevlar49/epoxy 40-in. vessels in question (see 


NASA/TM— 2009-21 5830 


3 



Ref. 1 . (Originally there were two other models, Model 1 and Model 3, but these proved irrelevant and 
were dropped from consideration (Ref. 2)).) 

Uncertainties regarding these two basic parameter pairs are the major driver of the relatively low 
predicted reliability of these vessels and any shrinking of this uncertainty would yield major benefits in 
terms of predicted reliability. Available data prior to the test data allows calculation of what is called a 
Bayesian ‘prior’ joint uncertainty distribution on all the parameter values as well as the reliability overall. 
Depending on the lifetime of SN007 observed from the test, Bayes theory allows calculation of a revised 
‘posterior’ uncertainty distribution from which updated reliability predictions can be made for the 40-in. 
COPVs in question. In essence, the longer the vessel lasts the better the future reliability. 

The results of the Bayes analysis calculations show that the longer vessel SN007 survives in the stress 
rupture test, the more likely it becomes (and dramatically so) that the more optimistic Model 2 for the 
stress ratio is correct. Beginning the test with probability 0.5 (even 50-50 chance) that Model 2 is correct 
rather than Model 4, the posterior probability Model 2 is correct rises even higher to 0.95. The ultimate 
effect on the predicted reliability of the 40-in. COPV in question is dramatic, being of the order of one 
‘nine’ (reduction in the predicted probability of failure by an order of magnitude). The test turns out to be 
much less effective in choosing between the two competing lifetime shape parameter values, though there 
is a slight shift in favor of the more optimistic value, as the vessel survives longer and longer. Regarding 
the two competing shape parameter values, the case of putting three identical vessels on test is considered, 
and if they all fail fairly close together in time, a prior probability of 0.5 that the optimistic Weibull shape 
parameter value is correct rises to 0.76. However, to be as effective as in choosing between the two stress 
ratios at least 6 identical vessels would be required. 

Reliability Model with Various Uncertain Parameters 

For the stress-rupture testing, we consider the application of many sequential future mission cycles 
each of duration t mc given that the vessel has survived the equivalent of m such mission cycles in the past. 
These cycles may actually involve pressurization and depressurization at the beginning and end of each 
cycle or simply be convenient divisions of time under steady pressure. (The overwrap lifetime has been 
shown to depend primarily on the cumulative time under pressure.) The model for the probability of 
survival of n such mission cycles is given by 
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where t» = nt mc and t m = mt mc and various other parameters in Eq. (1) are viewed as random variables with 
uncertainty distributions based on previous data and the stress ratio and Weibull lifetime shape parameter 
values. In particular 

s m stress ration on 40-in. vessel SN007 

p power-law exponent relating stress ration to the lifetime scale parameter measured from the 

LLNL database 
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P Weibull shape parameter for the lifetime relevant to 40-in. vessels and determined from the 

LLNL database and test results from NASA Fleet Leaders. 
t ref characteristic lifetime at stress ration unity estimated from the LLNL database 

X LLNL a random variable reflecting uncertainty in the stress ratios used to generate the LLNL 

database as a result of a limited number of burst tests 
Regarding notation, placement of a double-arrow over a parameter, 0, to give, 0 , means that the 
parameter is treated as a random variable having an uncertainty distribution that may be one of several 
types: normal, log-normal, Weibull, Beta or Bernoulli. Each has parameters reflecting central tendency, 0 
, and variability, co . For instance, for a log-normal uncertainty distribution on a parameter, 
ln§ = Normal ( In 0, k>) means ln§ has a normal uncertainty distribution, which implies 0 follows a 
lognormal distribution, where 0 is viewed as the mean of 0 and ro = c/0 is its coefficient of variation 
(standard deviation, c , divided by mean, 0 ). Note that in this lognormal case, <n is entered into the 
normal distribution as though it were a standard deviation parameter. Also, 0 = Beta(a,bj means 0 
follows a Beta uncertainty distribution on (0,1) with parameters a and b , which will be characterized 
later in terms of the mean and coefficient of variation of 0 . In addition, I = Bernoulli ( p) means I is an 
indicator random variable that follows a Bernoulli distribution, which means that I has possible values 1 
or 0 with probabilities p and 1 -p, respectively. Finally 0 = Weibull(0,a j means 0 follows a Weibull 
uncertainty distribution with scale parameter, 0 , and shape parameter, a . (Note here that 0 is not the 
mean of the uncertainty distribution, since the mean is actually 0T(l + l/a) .) 

With this background, the uncertainty distributions for the parameters in the model based on prior 
information (primarily the LLNL vessel data base) are as follows: 

lnp = Normal(lnp,c p ) (2) 

ln Lef = Normal (ln/ ref - pin s piv , c^ ) + p In s piv (3) 

where s piv is a constant called the pivot stress ratio (which is the mean of the stress ratios for all 
specimens for which lifetimes were obtained) 

^ n ^“LLNL = Normal ^ In X, LLNL ,c^ j (4) 

Also 

P = Porb^ + PlLNL ( 1 - 4*. ) 

where 

7 P(>b = Bernoulli^ J (6) 

Here Eq. (5) indicates is that there will be two competing versions of the Weibull shape parameter for 
lifetime: one is Pllnl the currently accepted value based on the LLNL data base, and one is p 0rb based on 
data from Orbiter vessels, mainly the JSC Fleet Leaders discussed elsewhere in a white paper (Ref. 1). In 
Eq. (6), pn is the pre-test or ‘prior’ probability that p 0r b is the correct value to use for reliability 
modeling of the large 40-in. vessels of primary interest. Also 
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( 7 ) 


7*PlI,NI, ^ ^Porti 

is the prior probability that Pllnl, is correct instead. For each of the two Weibull shape parameter choices, 
the uncertainty distributions are respectively 

l n Pllnl = Normal ^ In [3 LLNL >®p LLNL ) (8) 

and 

taPorb = Normal(lnp 0tb ,© PoA ) (9) 

The stress ratio on SN007 has the uncertainty structure 

^007 = %)7,M27m2 + ^007,M4 ( 1 _ ) 0^) 

where 

/ M2 = Bernoulli (/» M2 ) (11) 

Equation (10) indicates that the stress ratio model for SN007 also involves two competing versions taken 
from Reference 2: the first is Model 2, which involves stress ratio s 0 07 ,M 2 , and the second is Model 4, 
which involves stress ratio, ^ 0 07 ,M 4 - Model 4 is virtually the same as currently used model for these 40-in. 
vessels. For vessels that have high delta volumes from autofrettage (i.e., high permanent volume growth 
from liner yielding during proof testing), Model 4 gives significantly higher stress ratios than Model 2. In 
Eq. (1 1), p M 2 is the pretest or ‘prior’ probability that Model 2 is correct, in which case s 0 07 ,M 2 would be 
the correct stress ratio value to use in reliability calculations. The probability that Model 4 is the correct 
one is 


PM4 ~ 1 PM2 


( 12 ) 


in which case s 0 07 ,M 4 would be the correct stress ratio to use. 

Regarding the uncertainty distribution for each stress ratio, given that its particular model is the one, 
we consider two versions: One version is based on the Beta distribution and the other is based on the 
Weibull distribution. The Beta distribution is commonly used to represent prior distributions in Bayesian 
analysis, but the Weibull distribution is more natural in this case since the stress ratios in the Orbiter 
vessels are ultimately based on the outcomes of one or two burst tests where the underlying burst strength 
is typically Weibull. In the Beta version we have 

%)7,M2 = Beta^a 2 ,b 2 j (13) 

^ 007 , M 4 = Beta ^ a 4 , 7 4 j (14) 


where a t , b t ,are parameters of the Beta distribution for Model i as explained later. In the Weibull version 


^007, M2 _ Weibull(i 007)M2 /r(l + l/d 2 ),d 2 ) 


(15) 
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^007, M4 = Weibull(i 007M4 /r(l + l/a 4 ),a 4 ) 


(16) 


where a = pP is the Weibull shape parameter for burst strength, whose effect is also discussed in more 
detail later. Following a brief comparison of the two versions, which yield virtually the same mean and 
95% confidence bound on predicted reliability, we use the Weibull version for all examples, since the 
Beta version offers no advantage. 

For a standard mission duty cycle of the 40-in. vessel under study, the currently used parameter 
values (before running the test) are 


tmc= 105 hr 

t m = 3465 hr (past survival time of SN007 at standard conditions) 

p = 24 
ro p = 0.04 

Kef = ^i.i.n i, = 1 .43 hr 


.Sp iv = 0.7 (pivot stress ratio, which is the mean of LLNL vessel stress ratios) 


(17a) 

(17b) 

(17c) 

(17d) 

(17e) 


^LLNL - 1 

<b, =0.0030 

a llnl 


Pllnl 

^Plenl 


= 1.625 
= 0.080 


(lifetime shape parameter based on LLNL vessel data) 


(17f) 


( 17g) 


However based on recent analysis of similar but smaller vessels, called JSC Fleet Leaders (Ref. 1), we 
propose the alternative Weibull shape parameter for lifetime given by 


P 0rb = 2.45 (lifetime shape parameter based on Orbiter type data) 

“Po * =0 - 30 


(17h) 


and we earlier introduced the idea of the prior probability, /5h , that P Qrb is the correct choice for 

lifetime shape parameter, not P LLNL . Later we consider various cases, fi^^ = 0, 1/5, 1/2, 1 , but 
primarily use fin = 1/2 based on our prior judgment (though a strong case can be made for using 
P Qrb = 2.45 exclusively, i.e., p PoA =1 as is discussed in [1]). The two alternatives for the stress ratio 
model are 


i 007 m 2 = 0.599 (estimate of stress ratio from Model 2) 

® M 2 = 1 . 2/&2 

i 0 07 m 4 = 0.653 (estimate of stress ratio from Model 4) 
®M4 = l-2/a 4 


(17i) 


(17j) 
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where 


“2 =PorbP = 59 

(18) 

= PlLNlP = 39 

(19) 

and here too we have introduced the idea of the prior probability p M2 that Model 2 is correct. Among 
various cases we consider are /j m2 =0, 1/5, 1/2 and 1 , although most of the examples assume our first 

/y a 

judgment value p M2 = 1/2 . Also, returning to the Beta distribution parameters a 2 ,b 2 , and a A ,b A , these 
are calculated from Eqs. (17i) and (17j) as 

~ (l ^007,M2 )/ (®M2 ) %)7, M2 

(20) 

^2 = ^2 (l - ^007, M2 )/%)7,M2 
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b 4 - a 4 (l ^007, M4 ) /^007,M4 

(23) 


Note that with the prior choices, = 1/2 , on the lifetime shape parameter and, p M2 = 1/2 , on stress 
ratio Model 2, the predicted vessel reliability is influenced most by the pessimistic values P LLNL = 1.625 
and i 007M4 = 0.653 since they each have probability 1/2. The more optimistic Orbiter based values cannot 
significantly improve the predicted vessel reliability unless the probabilities, and p M2 , are much 
higher than 1/2. 

A complete derivation of the two stress ratio models is given in (Ref. 2). These models capture two 
alternate interpretations of the various data obtained in the WSTF testing of SN01 1 . The higher stress 
ratios in Model 4 are primarily due to assumed overwrap stiffness loss in a vessel that is proportional to 
delta volume from proof. This was about 12% in SN01 1 and is assumed to be about the same in SN007 
when using Model 4. Model 2, however, assumes this large stiffness loss was a peculiarity only of 
SN01 1, which was sidelined as a special test vessel and was never put into service. Study of the WSTF 
cycling and burst test data, original manufacturer data, and outer surface profile measurements made in 
2005 strongly suggest that SN01 1 was a singularly anomalous vessel that is uncharacteristic of other 
OMS vessels, especially those with serial numbers SN015 and above currently in service. 

It should be noted that, in general, the model stress ratio is defined as the applied fiber stress in the 
vessel (as determined from a mechanical analysis based on the applied pressure) divided by the Weibull 
scale parameter for effective fiber strength as determined from burst tests. However, in the 40-in. vessels, 
only one burst test was performed originally (SN002-Q), and as mentioned, one was performed later 
(SN01 1), which itself required much interpretation. Thus, the burst values obtained are not adequate to 
perform a standard maximum likelihood analysis to estimate the Weibull scale parameter for effective 
fiber strength in the denominator. The fiber strength values obtained from one or two burst tests are more 
appropriately taken as estimates of the mean of the Weibull distribution. Thus, to estimate the scale 
parameter, the values from the burst test must be divided by T ( 1 + l/a ) , which increases their value by 2 
or 3%. The stress ratio values given above in Eqs. (17i) and (17j) for SN007 and for Models 2 and 4 
already reflect this adjustment, and thus, are slightly lower than when using the burst-strength based value 
for fiber strength directly in the denominator. 
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It turns out, however, that when using the Weibull distribution to model the uncertainty in the stress 
ratio, the factor T(l + 1/a) enters once again since simulated stress ratio values will on average be lower 
in value than s 007 , when it is used directly as the scale parameter. Thus the same correction of dividing 
by T(1 + 1/a) is required again, as seen in Eqs. (15) and (16), but this time the effect is on the numerator 
of the stress ratio, and thus the two effects cancel. Thus, one might conclude that the correction can be 
ignored altogether; however, the first correction is needed in determining the parameters in the Beta 
distribution, given in Eqs. (20) to (23). The need for care in these corrections is readily apparent when 
comparing reliability results based on the Beta uncertainty distribution on stress ratio versus the Weibull 
distribution. 


Bayesian Framework for Data Analysis 

We let 0 be a vector of possible uncertainty parameter values for the basic model 


§ ~ (p > W AlLNL »P Orb ’PlLNL ’ ‘ V 007,M2 » - V 007,M4 ) 


(24) 


which excludes for the moment the Bernoulli uncertainty regarding the correct choices of the Weibull 
shape parameter value and the stress ratio model. We let q(0) be the prior likelihood function for all the 
parameters represented in uncertainty vector, 0 . Thus r|(0) is the product of all the Normal and Beta or 
Weibull uncertainty density functions above. We also let 


^oo7(«|0» z '»2'; w ) = ex P1 
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be the prior estimate of reliability after n test cycles, given possible values of these parameters in 0 from 
their space Q 0 , and all four possible pairs of choices of the shape parameter value and the stress ratio 
model, and where 


m=\ 


fi P llnl, z_ 0 


J Orb ’ 


2 = 1 


(26) 


and 


5 007 


U) = 


[ %)7,VI4 >7-0 

[^oo^ive, 7 = 1 


(27) 


Thus for any set of parameter value choices in 0 and survival of a given number of mission cycles, n, we 
can easily calculate T? 0 07 . We also let 




PVuxlP™> 

Pp ort) / , M4> 

l [ \[ M2 ’ 

[/ J P 0rb / , M2> 


2 = 0 , 7=0 

* = 1,7 = 0 

i = 0,7 = 1 

* = 1,7 = 1 


(28) 
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where we recall /?p LLNL = 1 - p Qrh and p M4 = 1 - p M2 . This is a bivariate Bernoulli distribution of ‘prior’ 
probabilities on the correct Weibull lifetime shape parameter and stress ratio model. Then given survival 
by the test vessel of n mission cycles, i.e., N> n, the posterior distribution for the parameter uncertainties 
is 


h(Q,i,j 


n;m) = 


^("|9»U;w)n(9)/» 0>w (i',./') 

X Po,m{ U ’ V )\ / W«|0> M > V ; W ) T l(0) fi? 0’ 

H,V=0,1 Q § 


Uj = 0,1 


(29) 


where the integration is over the vector space Q 0 for all possible values of parameters in 0 . The case 
when failure has occurred during mission cycle, ~N=n, is handled similarly. In this case R 001 ( n \ Q,i,j; m) 
is replaced by 




f „ ( :\ YP( ! ' 


3 007 


U) 


V ^LLNL J 


f. >P(0 


V^ref J 


(n + mf^ ' , i,j = 0,\\ 0e Q 0 (30) 


based on the probability density function of the failure time multiplied by t mc . 


Independence of LLNL and Orbiter Based Uncertainty Parameters 

The uncertainty parameters developed from the LLNL data base are automatically independent of 
whatever lifetime N= n is observed in the test of vessel SN007. Thus the posterior marginal uncertainty 
distributions of these parameters will be the same as their prior marginal distributions. Secondly, the Beta 
or Weibull distributed uncertainty in the individual stress ratio s 0 07 ,M 2 from Model 2 and the stress ratio 
*s'oo 7 ,M 4 from Model 4 arose solely from (i) analysis of mechanical data (strain gages, DIC, eddy current 
probes) from the cycling and a burst test of SN01 1, (ii) the qualification reports on proof- testing, the 
cycling and original burst test of SN002-Q or SN003-Q, and (iii) study of the data supplied by the 
manufacturer for each of the 34 OMS service vessels. 

Thus, the posterior uncertainties reflected by Beta or Weibull distributed uncertainty parameters in 0 
for the two possible stress ratio, ^oo 7 ,M 2 and £ 007 , M 4 , will be the same after the test as the prior uncertainties 
irrespective of the observed cycles to failure. This is because the largest component of these uncertainties 
arises from mechanics models interpreting two burst tests, on SN01 1 and on SN002-Q. However, what 
will change due to the test are the uncertainty probabilities, and p M2 , on which stress ratio model 
and lifetime shape parameter are correct. The ‘prior’ probabilities will change to ‘posterior’ probabilities, 
denoted Pp 0rb>n and p M2 n , depending on the number of cycles to failure, N=n. 

Thus, in advance of the test we can integrate out all the marginal joint distributions for all remaining 
uncertainty parameters reflected in 0 since they remain unchanged. Then we can focus on the two 
Bernoulli distributions characterizing the correct choice of the Weibull lifetime shape parameter and 
stress ratio model. Carrying out this integration over 0 in the numerator of h(Q,i,j \ n;m) above, we 
obtain the bivariate Bernoulli posterior distribution 


h(i,j 


n;m) = p nm (i,j) = 




n,m 


W 




’ 

W 

n,m 

I W 
rv n,m 


Wp^Pm, i = 0,j = 0 
(i,j) Pfiab PM4, i=hJ = 0 
* = <W = 1 
(i,j)p^ PM2 , i = l,j = l 


(31) 
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where 


{ ^ ? oo7(”|0’ z ^';'«)ti(0)c?0 


W n,m{ i ’j) = - 


X J Po,m( M » V ){^OO7(«|0 5 M 5 V ;" I ) T l(0)^0 


, 1,7 = 0 , 1 . 


(32) 


W,V— 0,1 


Qq 


are special weighting factors that depend on the number of survived cycles, n. The case where failure has 
occurred on mission cycle N= n exactly, is treated in a similar way except that R 001 ( n \ Q,i,j;m ) is 
replaced by / 007 (n | Q,i,j-,m ) . In this case the weights w (i,j) will be different, especially if failure 
occurs very early. The above analysis can also be extended to the case of several vessels, k, put on test, 
with N x =n x ,N 2 =n 2 ,-- -,N k = n k being the failure times. In this case, / 007 ( n \ Q,i,j;m ) is replaced by the 
product 

/oo7(«i |0 ! z ' J y';w)/oo7(«2l0 J z ' J 7;» z )---/oo7(«itl0’^7; m ) ( 33 ) 

Whatever the test circumstances, the posterior probabilities for the lifetime shape parameter Pllnl and 
stress ratio Model 2, being the correct choices are, respectively 

Pfl 0rb ,n= PnA l ’ 0 ) + Pn,m{ l ’ l ) = W n,m{ l ’ 0 )PVo' t ,PM + ( 34 ) 


and 


PM2,n=Pn,m{°’ l ) + Pn,m{ l ’ l ) = W n,m( 0 ’ l )PLLNLPM2 +W n,m{ 1 ’ l )P^PM2 ( 35 ) 


Calculation of Posterior Uncertainty Distribution on Reliability 

To calculate the posterior uncertainty distribution on the reliability of SN007, we must carry out the 
integration in all four w nm (ij) components, and this is accomplished using Monte Carlo simulation. Then 
the posterior probability components p n , m (ij ) can be calculated as well as the posterior probabilities, 
Aw* and Aw>" =1_ Aw and PM 2 ,n and Pu 4 ,n= l -Pu 2 ,n regarding which of the two Weibull 
lifetime shape parameters and stress ratio models are correct. The calculation of the posterior uncertainty 
distribution on the reliability must be performed over the full space of possible parameter values, 

Qq ® [(0,0), (1,0), (0,1), (1,1)] , where the quantity in square parentheses represents the possible bivariate 
Bernoulli values which determine the particular stress ratio model being used (Model 2 or Model 4) and 
the Weibull shape parameter being used (Pllnl or p 0r b) as defined in Eqs. (26) and (27). One technical 
note is that numerical study of the various components shows that the posterior Bernoulli random 
variables, A 0 h,.« and 4c ,« are virtually independent in the posterior, as was assumed in the prior. Thus, 
in keeping with Eq. (30), the posterior bivariate Bernoulli probabilities can be taken as 


hu^,nPm,n, i = 0,j = 0 
..uh^nPMA^ i = U = 0 

l = °’J = l 

[Aw«^M2,„> * = 1J = 1 


(36) 
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As the final step, to calculate the posterior uncertainty distribution on the reliability we have used 
Monte Carlo simulation to determine > 50,000 replicated outcomes of all model parameters in the 
extended vector space, Q = Qq ® [(0,0), (1,0), (0,1), (1,1)] , including Bernoulli outcomes generated 
using Eq. (36). From each replication we calculate a reliability value using Eq. (1), and the uncertainty 
distribution is the empirical distribution function generated from the set of calculated reliabilities. 
Conceptually, we are calculating the uncertainty distribution function 


, (Ro 07 («I W )<^) 

1 ^(^007 < ^) 

i i 

M 

^3 

a 

3 


h(eye] 

« i 

Pn,mM J 

^0 


= X Pn,m( i J) p (^ooi{ n \ i J’ m ) < R )> 0<R<\ 

i, y'=0,l 


( 37 ) 


where the numerator calculates reliabilities only for combinations of all parameter values in Q which 
yield R 001 < R , given reliability level, R. Below, R is expressed in numbers of ‘nines’. 

Effects of Prior Probability Assumptions and Beta 
Versus Weibull Uncertainty on Stress Ratio 

Next we consider a comparison of uncertainty distributions on the predicted reliability for one 
mission cycle of SN007 based on the Beta versus Weibull distribution for modeling stress ratio 
uncertainty. The Beta parameter values have been chosen as given above, and the Beta and Weibull 
coefficients of variation have been chosen to match. Results are calculated for various prior or posterior 
probabilities p^ = 1 -^p LLNL and p M2 = 1 - p M4 . 
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Figure 1. — Comparison of reliability predictions on SN007 for a mission cycle tmc= 105 hr, given 
pessimistic p^ = Pm 2 = 0 , mixed = p^ 2 = l/ 2 ancJ optimistic p^ = p M2 = 1 cases. 
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Predictions applicable to one mission of a vessel similar to SN007 are shown in Figure 1 for t mc = 105 
hr, and past survival t m = 3465 hr. The most pessimistic case is = p M2 = 0 , so (3 LLNL =1.625 and 
5 0 07 jM 4 = 0.653 . The mixed case assumes p^ = p U2 = 1/2 , and the most optimistic case p^ M = p M2 = 1 , 
where = 2.45 and s 007M2 = 0.599 applies. Monte Carlo simulation was used on all model parameters 
including the Bernoulli random variable reflecting the choices of the lifetime shape parameter and stress 
ratio Model. We find that the point estimates of the predicted reliabilities are the same for both the Beta 
and Weibull versions and the mean reliabilities and point reliabilities are close, especially for the most 
optimistic case. For the more pessimistic cases, however, the Beta distribution gives slightly lower 
predictions. 

The cause of this more pessimistic behavior in the Beta distribution case rests in the behavior of the 
deep tail, which reflects the premise that the stress ratios calculated from one or two burst tests may, in 
rare cases, be much worse than the true value. This would require that the original burst test (one or two) 
reflected unrealistically strong vessels from the population. However, this is more a characteristic of the 
behavior of the upper tails of the Beta distribution itself, which assumes a power form for the probability 
of strong vessels occurring in the original burst tests to set stress ratio. The Weibull distribution, however 
has an exponentially decaying upper tail, and consistent with experimental observation on various data 
sets of strands and pressure vessels, indicates that vessels significantly weaker than the mean strength of 
the population are in fact much more likely to be selected than vessels much stronger than the average. 
Thus the Weibull uncertainty approach is judged more realistic and we shall henceforth use it. 

Case Studies and Main Results 

Testing and Results Under Standard Operating Conditions 

Next we describe what would happen in a stress-rupture test on SN007, using standard operating 
conditions: pressure p M op = 4875 psi and temperature, T Tet = 81 °F. In the analytical framework above, to 
obtain significant gains in predicted reliability of OMS-type COP Vs, it is necessary to have test 
conditions under which significantly increased posterior probabilities are possible compared to prior 
probabilities, that is p p n > p» and p M2n > p M2 . This means that the test must be run long enough that 
under the most optimistic scenario, = 2.45 and s 6/1M2 = 0.599 , the vessel has at least a 50% chance of 
failure, and preferably as high as 80%; that is, if it is tested to shorter than this time and the test is 
stopped, say, for budgetary reasons, there can be no significant improvement in the predicted reliability 
and the ‘status quo’ will remain. To limit the required test time to the maximum of 100 test cycles, each 
cycle must be nominally 4000 hr in duration. (A ‘cycle’ can be viewed merely as a convenient time block 
for analysis, and does not imply that the vessel must be depressurized and repressurized every 4000 hr.) 

Thus standard test conditions are set to be, t mCjt = 4000 hr, and t miPast = t m = 3465 hr, which is the 
past survival time under standard conditions. Thus the number, m t , of past mission cycles survived is 
m t = fmjagt/fmc.t = 3465/4000 ~ 1 . Hence, under standard test conditions, the number of ‘test cycles’, n t , at 
any point of the test will be the integer value of the total time on test divided by n t . What is seen 
immediately is that under the most optimistic test scenario, the past mission cycles survived amounts to 
only one cycle. Consequently in subsequent figures and discussion we abbreviate p„, m (ij) to p„(ij). 

We now consider various results regarding posterior estimates of the probability components p„(ij). 
and the posterior probabilities ^ Qrb > „ and p M2n as a result of running the stress rupture test and surviving 
varying numbers of mission cycles, n. Figure 2 presents posterior results for the case where the vessel 
is known to have survived n mission cycles, i.e., N> n at standard conditions p M op = 4875 psi and 
T rcf =81 °F. Before the test, the ‘prior’ probabilities for the shape parameter and stress ratio model, pa 

HOrb 
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and p M2 , were taken as 14 . Also shown is the probability that the vessel will fail by mission cycle n both 
for the most optimistic starting case p^ M = p M2 = 1 and the most pessimistic case Pp LLNL = Pm 4 = 1 • 

Note in Figure 2 that as more and more mission cycles are survived, the posterior probabilities 
/?Pllnl>" and p M4 n , for the pessimistic parameter values, shift to lower values especially the latter. This 
means that the corresponding posterior probabilities, P$ My „ and p u2 , n > increase for the optimistic vessel 
parameter values, and the increase is dramatic in favor of the optimistic stress ratio Model 2. Should the 
vessel survive to the median time 248,000 hr or 62 missions of the most optimistic scenario of parameter 
choices, we obtain = 0-55 and p M2 62 = 0.945 . The inset table in Figure 2 shows the resulting 

increases in predicted single mission reliability of an OMS vessel in current service similar to SN007 and 
for tmc = 105 hr and t m = 3465 hr. Unfortunately, this length of test time, 248,000 hr is not feasible, so 
shortly we consider accelerating temperature conditions to reduce the 248,000 hr to more manageable 
time. 

Nonetheless, to obtain the corresponding OMS COPV service mission reliability predictions 
(t mc = 105 hr), assuming test survival as described above, we used Monte Carlo simulation on all model 
parameters including the Bernoulli random variable reflecting the choices of the lifetime shape parameter 
and stress ratio Model. For these Bernoulli random variables we used the posterior values 62 = 0.52 
and p M 2 62 = 0.945 obtained in Figure 2. The most important observation is that thee reliabilities relevant 
to one mission cycle in service increase on the order of one ‘nine’ (slightly less for the mean and point 
estimate and slightly more for the 95% bound). 
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Figure 2. — Posterior probability components versus mission cycles, n, survived assuming prior 
probabilities p p = Pm 2 = 1/2 , Pmop = P si ancJ ^ref = 81 ° F . Also shown are probabilities 
of vessel survival to various cycles, n, as well as prior and posterior reliability at n- 62. 
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In Figure 3 we present posterior results for the case where the vessel is known to have failed exactly 
on mission cycle n, i.e., N=n, under the conditions of Figure 2. As failure occurs at later and later cycle 
numbers the posterior probabilities, Pp Qrhtn > f° r the more optimistic Weibull lifetime shape parameter, 
eventually become slightly higher than in Figure 2 (about 0.55 compared to the value 0.5 at test start), 
whereas the posterior probabilities, p M2n , for optimistic stress ratio Model 2 are not quite as high as in 
Figure 2, though still very high. However, if failure occurs very early (even early for the pessimistic 
model scenario), p M4 n jumps to almost 1 and P$ LLSL> „ jumps to 0.6, as ought to be the case. This does 
not occur in Figure 2 since knowing N = n early on provides little true information. Generally in Figure 3 
we note that the predicted Orbiter OMS mission reliabilities for the case N= 62 are only slightly different 
from those for A > 62 in Figure 2, and again reflect a reliability gain of about one ‘nine’. 

Figure 4 presents corresponding results to Figure 3 for the cases where the prior probabilities are 
reduced to 0.2, respectively, for choosing the optimistic scenario p 0 rb = 2.45 and stress ratio Model 2; that 
is, the prior probabilities are slanted heavily to the most pessimistic assumption. Otherwise the parameter 
choices are the same as in Figures 2 and 3 namely. Despite beginning with the more pessimistic prior 
probabilities, as more and more missions are survived there is still a major shift in the posterior 
probabilities, Pfr Mt „ and p M2n > but there is also further room to grow as the posterior values are not as 
high as starting with 1/2. This also means that the prior reliabilities are also slightly worse but in the end, 
the relative gain in reliability from prior to posterior is approximately the same. The general features of 
the behavior for the case N= n in Figure 4 compared to Figure 3 remain qualitatively the same. 
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Figure 3. — Posterior probabilities versus mission cycle, n, when failure occurs for the prior values 
p Portj = Pm 2 = 1/2 , Pmop = 4875 psi and T ref = 81 °F . Also shown are probabilities of vessel failure at 
various test cycles, n, as well as prior and posterior reliability at n = 62. 
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Figure 4. — Posterior probabilities versus mission cycle, n, when failure occurs for the case 

jDpo* = Pm 2 = 1/5 = 0.2 , p^ 0P - 4875 psi and T ref = 81 °F . Also shown are probabilities of vessel 
survival to various cycles, n, as well as prior reliability and posterior reliability at N = 62. 


Test Acceleration using Increased Temperature and Pressure 

It is clear from the above example that unless some form of acceleration is used, the test time is 
impractically long (248,000 hr or 28 yr) to achieve the outcome that stress ratio Model 2 is correct. Thus 
it is necessary to accelerate the test using an increase in pressure or temperature or both. We let T Q \ and p e \ 
be elevated temperatures and pressures relative to the standard conditions T tg{ and p nf9 the latter being 
maximum operating pressure, 4875 psi, for an OMS vessel. It is shown in [2] that for any elevated 
pressure, p Q \, the stress ratios for Model 2 and Model 4 are, respectively, 


rC Orb,LLNL 


1430 


and 


*^M4 ( Pel » ^ref ) 


W A Av 

4 ’ a> 007 
rC Orb,LLNL 


^^007 + 


Pel 


(8.674-5.415(0.1421)) 

1430 


(38) 


(39) 


where W 2y =0.978 and W 4 Ar =1.011 are Weibull based correction factors for through-thickness 
gradients in the tow (wrap layer) tensions, and for SN007 the delta volume (permanent volume growth 
from autofrettage) is approximately AF 007 = 340 in. 3 . Also, rc 0rh LLNL = 1 .02 is a pressure rate correction 
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factor in interpreting the burst tests since the LLNL database COPVs were pressurized at a slower rate 
than the OMS vessels. 

We also have temperature acceleration adjustments we can make to produce higher effective stress 
ratios to substitute into the model as discussed in Reference 1. The effective stress ratios from 
temperature acceleration are 


S' (n T 1 — rh' 7 rei'.*j/ 7 d.K r’ l rp 
l5 M2l./ 7 el’ i el/“ g ^ ‘ 3 M2(/ 7 el’ 7 ref 

S' (n T j S' ( n y 

l5 M4l./ 7 el’ V el/“ g ^ l5 M4l./ 7 el’ 7 ref 


,K l^,K 


(40) 

(41) 


Where ® = 2.86 is the 0 °K stress ratio convergence point determined from experiments 

7^ f K = 300 ° K (80.6°F), r refF =32 + (9/5)(300-273) = 80.6°F (42) 


and 


W = 300 + (5/9)(^-T ref;F )°K (43) 

Finally we adjust the past survival times to correspond to the new stress ratios according to 

past, el =t m{ Pe 1 »^el ) = t m( Pref ’ ^ref ) [ ^M4 ( Pref > ^ref )/^M4 ( Pe 1 » ^el )] (44) 

as well as the Weibull shape parameters at elevated temperatures 

P Orb ( ^el ) = P Orb ^el,K /^ref,K (45) 

and 

PlLNL ( ^el ) = PlLNL ^'el,K /^ref,K (46) 

Main Results Under Accelerated Test Conditions 

We first considered the case p e \ = 5750 psi and T e \ = r re f= 80.6 °F; that is, a greatly increased pressure 
is used to accelerate the test but the temperature remains ambient at 7^= 80.6 °F. This reduced the test 
mission cycle time to 306 hr but for 61 mission cycles to reach the median time to failure under stress 
ratio Model 2, the test would still take 18,666 hr or 26 months, again longer than desirable. Such a large 
increase in test pressure also poses risks to the titanium liner and ultimately is not viable as a test option. 

The next case considered was the standard service pressure, p mop = 4875 psi, but temperature 
accelerated to T c] = 145 °F. Figure 5 shows results where to reach the median time to failure under Model 
2 the test now takes 4560 hr or about 6 months. Apart from shorter tests times in this accelerated case, the 
basic pattern of vessel probabilities of failure under SR Model 2 and Model 4 as well as prior and 
posterior probabilities are about the same, though accelerating the temperature does show a slight 
advantage in posterior probabilities and reliabilities. 
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Figure 5. — Posterior reliabilities versus number of mission cycles survived assuming prior 

probabilities =p M2 = 1/2 a test pressure of p test = p mop = 4875 psi , and T test = T el = 145 °F . 


Figure 6 shows results for the compromise choices, p c \ = 5175 psi and T e \ =130 °F. In this case the 
test takes 4774 hr again about 6 months for the vessel to reach the median time to failure under stress ratio 
Model 2. 

Since the posterior probabilities on the choice of the Weibull lifetime shape parameter are little 
changed lfom the prior values, we consider the case of testing two and three vessels, respectively, under 
standard test conditions and where they all fail within a few cycles of each other. Figure 7 shows posterior 
probabilities versus mission cycle, n, for three vessels put on test and all failing close together in time so 
there is very little variability. Other parameters are = p u2 = 1/2 , and standard test conditions are 
assumed , /?mop = 4875 psi and T re{ = 81 °F. 

Figure 7 shows that if failure occurs for all three vessels near n = 62 mission cycles, then the posterior 
probabilities all improve and are Pp 62 = 0-76 and Puifii = 0.945 . While the posterior reliabilities also 
increase for an OMS mission cycle on a vessel like SN007, dramatic gains stemming from a high 
posterior probability of the optimistic shape parameter would require testing many more vessels. 

Thus, without testing many vessels, the test does little to resolve whether the Weibull shape parameter 
Porb = 2.45 is correct or Pllnl = 1 .625 is correct as the posterior probability is increased only slightly over 
the prior value pa . One must rely on studying Fleet Leader and Orbiter data itself to make that choice 
(Ref. 1). 


NASA/TM— 2009-21 5830 


18 


Posterior probabilities 


1 


0.9 

0.8 

0.7 

0.6 

0.5 

0.4 

0.3 

0.2 

0.1 

0 



0 10 20 30 40 50 60 70 80 90 100 

Mission cycles, n 


Figure 6. — Posterior reliabilities versus number of mission cycles survived assuming prior probabilities 
= Pm 2 = 1/2 , a test pressure of p te st = 5175 psi, and T tes t = T e i = 130 °F. 
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Figure 7. — Posterior probabilities versus mission cycle, n, for three vessels on test and all failing close 
together in time (so very little variability). Other test parameters are p ^ = p^ 2 = 1/2 , Pmop = 4875 psi 
and Tref = 81 °F. 
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Figure 8. — Uncertainty distributions and predicted reliabilities for one Orbiter mission of an OMS vessel like 
SN007 under various stress ratio models and lifetime shape parameter assumptions. 


Finally Figure 8 shows a comparison of the cases in Figure 1 together with the case of stress ratio 
Model 4 being correct but also p 0 rb = 2.45 being correct. The predicted reliabilities for one service 
mission cycle of a vessel like SN007 are about the same for = p M2 =1/2 . However for the most 
optimistic case where stress ratio Model 2 and p 0 rb = 2.45 are correct, the predicted mean reliability is 
about five ‘nines’ and 95% bound exceeds four ‘nines’. 


Concluding Comment 

It remains a misconception that testing one vessel can validate the reliability model; such a test can do 
no such thing. Validating the model would require several vessels tested at each of several stress ratios. 
What the test can do is sort out questions about the correct stress ratio model to use, which in turn would 
point to SN01 1 being a singularly anomalous vessel for which there is much evidence. Clearly a properly 
run test can yield great benefits in improving the reliability, of the order of one order of magnitude or one 
‘nine’. 
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